פירוש על עבודה זרה 105:16

In all of these scenarios, the owner hopes to recover his idol and therefore has not annulled it in his heart.
According to the rabbis, when the Canaanites fled when Joshua was conquering the land they intended to return. Therefore, they were not really abandoning their idols.